DOUBLE SCHUBERT POLYNOMIALS AND DEGENERACY 
LOCI FOR THE CLASSICAL GROUPS 
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Abstract. We propose a theory of double Schubert polynomials {X, Y) 
for the Lie types B, C, D which naturally extends the family of Lascoux and 
Schiitzenberger in type A. These polynomials satisfy positivity, orthogonality 
and stability properties, and represent the classes of Schubert varieties and 
degeneracy loci of vector bundles. When u! is a maximal Grassmannian ele- 
ment of the Weyl group, {X, Y) can be expressed in terms of Schur-type 
determinants and Pfaffians, in analogy with the type A formula of Kempf and 
Laksov. An example, motivated by quantum cohomology, shows there are no 
Chern class formulas for degeneracy loci of 'isotropic morphisms' of bundles. 



0. Introduction 

In recent years there has been interest in finding natural polynomials that represent 
the classes of Schubert varieties and degeneracy loci of vector bundles (see |Tu | and 
|FP| for expositions). Our aim here is to define and study polynomials which we 
propose as type B, C and D double Schubert polynomials. Special cases of these 
polynomials provide orthogonal and symplectic analogues of the determinantal for- 
mula of Kempf and Laksov [KL, . 

For the general linear group the corresponding objects are the double Schubert 
polynomials {&r:^{X,Y), w G Sn} of Lascoux and Schiitzenberger |LS| [L]. These 
type A polynomials possess a series of remarkable properties, and it is desirable to 
have a theory for the other types with as many of them as possible. Fomin and 
Kirillov FK' have shown that a theory of (single) Schubert polynomials in types 
B, C and D cannot satisfy all of the type A properties simultaneously. The theory 
developed here has qualities which are desirable from both the geometric and com- 
binatorial points of view. Our three families of double Schubert polynomials have a 
'common core', consisting of those polynomials which correspond to elements of the 
symmetric group 5„, sitting inside the respective Weyl groups. The polynomials 
in this core have positive integer coefficients and are obtained by specializing type 
A double Schubert polynomials. This has a natural geometric interpretation, using 
the inclusion of the corresponding isotropic fiag bundle into the partial S'L2n-fiag 
bundle obtained by omitting the isotropicity condition. 

When restricted to maximal Grassmannian elements of the Weyl group, the 
single versions of our polynomials are the P- and Q-polynomials of Pragacz and 
Ratajski |PR,2| . The latter objects are polynomials in the Chern roots of the tauto- 
logical vector bundles over maximal isotropic Grassmannians, which represent the 
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Schubert classes in the cohomology (or Chow ring) of the base variety. In this sense, 
they play a role in types B, C and D analogous to that of Schur's S'-functions in 
type A (note that Schur's Q-functions, introduced in to study projective repre- 
sentations of the symmetric and alternating groups, do not have the same geometric 
property |P2I 6.11]). The utility of the P- and Q-polynomials in the description of 
(relative) Schubert calculus and degeneracy loci was established in jPR,2| . More- 
over, according to jTa| and |KT1| . the multiplication of Q-polynomials describes 
both arithmetic and quantum Schubert calculus on the Lagrangian Grassmannian 
(see also |KT2| '). Thus, the double Schubert polynomials in this paper are closely 
related to natural families of representing polynomials. 

Our motivation for this work was the search for an explicit general formula for 
Lagrangian and orthogonal degeneracy loci; to place this problem in context we first 
recall the relevant results in the setting of type A. Let Q and V be vector bundles 
of ranks n and N ~ m + n respectively on an algebraic variety X, and consider a 
morphism of vector bundles ijj: V ^ Q. Assume that we have a complete filtration 

= K, c C Fa C • • • C Vat = F 

of V by subbundles such that dim Vi — i for all i. We are also given a rank sequence 
< ri < r2 < • ■ ■ < ^ which corresponds to an integer partition A = (Ai) 
with Ai = n + i — 7'i, and let |A| denote the sum of the parts of A. There is the 
degeneracy locus 

(1) X';^ = { X e X I rk(V;, (x) ^ Q{x)) ^ - i for all i }. 

Assume for simplicity that X is smooth and that X'^^ has codimcnsion |A| in X. 
According to |KL| . the class [X'^] of this locus in the Chow ring CH{X) is given by 
a Schur determinant: 

(2) [X'J = det(cA,+,-,;(Q - K.J)».j 

where each Ck{E~F) is defined by the Chern class equation c{E~F) — c{E)c{F)^^ . 
Suppose now that "0 is surjective, and consider the exact sequence 

— >S — >V — >0. 
In this case X^ coincides with the locus 

(3) Xa = { a; e X I dim(S'(a;) n (x)) ^ i for alH }. 

We would like to consider a direct analogue of ^ in types B, C and D (see 
Section ITTl for the precise definition). Unfortunately, as we shall see by example 
(Sectional, there are no Chern class formulas for degeneracy loci in this level of 
generality. We consider instead the analogue of the locus © for the other types, 
and begin with the Lagrangian case. Here ^ is a rank 2n symplectic vector bundle 
over X, and E and F are Lagrangian subbundles of V. The bundle F comes with a 
complete filtration F, by subbundles Fi C F, 1 ^ i ^ n. For each (strict) partition 
A with £ nonzero parts the degeneracy locus Xa C X is defined by 

Xa = { a; e X I dim{E{x) D F^+i^x^ (x)) ^i for 1 ^ i ^ }. 

Assuming that Xa has codimcnsion |A| in X, our main geometric result (Corollary 
0J is a determinantal formula for the the class [Xa] G C-ffl'*^l(X) as a polynomial 
in the Chern classes of the bundles E and Fi, which is a type C analogue of lO- 
CorollarieslHlandEI solve the analogous problem in the two orthogonal cases. These 



DOUBLE SCHUBERT POLYNOMIALS AND DEGENERACY LOCI 



3 



results answer a question of Fulton and Pragacz |FPI Section 9.5]; note that a priori 
it is not clear why [Xx] should be expressed as any polynomial in the Chcrn classes 
of the bundles. Our formulas generalize those obtained by Pragacz and Ratajski 
|PR2| for some special cases of these loci. 

The main ingredients used in the proofs are the geometric work of Fulton |F2| 
[F3 and Graham ( i!ra| and the algebraic tools developed by Lascoux, Pragacz and 
Ratajski PR2 LPlj |LP2| . The degeneracy locus formula (01 for X'^ was general- 
ized to maps of flagged vector bundles by Fulton |F1| . using the work of Bernstein, 
Gelfand, Gelfand 'BGG' and Demazure | D1| |D2 | and the double Schubert polyno- 
mials of Lascoux and Schiitzenberger |LSj Fulton later extended the geometric 
part of this story to the other classical groups |F2| |F3| : however there is no general 
degeneracy locus formula for morphisms between bundles in types 23, C and D 
(note that there are such formulas for morphisms with symmetries; see |HT| |.TLP| 

(ED |F3] pH2l lEEsl). 

To elaborate further, let V he a, vector bundle on X equipped with a nondegener- 
ate symplectic or orthogonal form. For each element w in the corresponding Weyl 
group there is a degeneracy locus X^,, defined using the attitude of an isotropic 
flag E, with respect to a fixed complete isotropic flag F, of subbundles of V (see 
|F3j |FP| or Sections 2, 3). In general one has an algorithm to write [Xw\ as a 
polynomial Pw in the first Chern classes X ,Y oi the quotient line bundles of the 
flags, by applying divided difference operators to a kernel P^j^ (X, Y) (which corre- 
sponds to the longest Weyl group element wq). The polynomial Pw„ represents the 
class of the diagonal in the flag bundle of V , and is defined only modulo an ideal 
of relations. Each specific choice of P^q produces a different family of representing 
polynomials P^ , which are candidates for double Schubert polynomials. The above 
construction ensures that the resulting theory of polynomials has direct geometric 
significance. 

As explained earlier, unlike the situation in type A, it is no longer clear which 
kernel will give the most desirable theory. For (single) Schubert polynomials there 
have been several works in this direction |BH| |FK| |PR2| |LP1| |LP2| . Candidates 
for double Schubert polynomials in types B, C, D are implicit in the works jF2| 
|F3j and |LP1I Appendix B3]. The double Schubert polynomials proposed in this 
article differ from both of these sources. We choose a kernel Pw^ {X, Y) leading to 
polynomials Pw{X, Y) (where P e {5B, £,3} depends on the Lie type) which have 
the following two main properties: 

(i) (Positivity) When w is a permutation in the symmetric group S'„, Pw{X^Y) 
is equal (in types B and C) or closely related (in type D) to the type A double 
Schubert polynomial Sroou^roo ('i^^o^j ~i^)j where tjj^ denotes the permutation of 
longest length in S'„. In particular, Q5u,(X, F) and £u,(X, F) have positive integer 
coefficients. 

(ii) (Maximal Grassmannian) When w is a maximal Grassmannian element of the 
Weyl group, Pw{X, Y) can be expressed by an explicit formula involving Schur-type 
determinants and Pfaffians. 

In type C our polynomials specialize (when y = 0) to the symplectic Schubert 
polynomials ^^{X) of |PR2j |LP1| . and, for maximal Grassmannian elements if, to 
the <5-polynomials of |PR2j . Properties (i), (ii) above combined with the results of 
|PR,2j |LP1| [LP2| can be used to push the theory further, and obtain 
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(iii) (Orthogonality) Products of the single Schubert polynomials Pw{X) = Pw{X, 0) 
give a (positive coefficient) orthonormal basis for the full polynomial ring, as a 
module over the ring of Weyl group invariants. This product basis corresponds 
in geometry to a split form of the fibration of the isotropic flag bundle over the 
maximal Grassmannian bundle, with fibers isomorphic to the type A flag variety 
(see Table [2 in Section EH- 

(iv) (Stability) The single Schubert polynomials Pw{X) satisfy a stability property 
under the natural inclusions of the Weyl groups. The double Schubert polynomials 
Pw{X, Y) are stable for certain special Weyl group elements, related to the loci for 
morphisms with symmetries referred to earlier. 

The hyperoctahedral group is a semidirect product of Sn with (Z2)". A central 
theme of this work is that the restrictions of double Schubert polynomials in types 
B, D to the two factors in this product (with the second realized by the maximal 
Grassmannian elements) are amenable to study and should be related to previously 
known families of polynomials. In fact, our polynomials are characterized (Propo- 
sition by specifying the values of their single versions for the maximal elements 
in each factor, assuming the kernel P^g satisfies a 'Cauchy formula' (Corollary [21). 

Our interest in these questions originated in an application to quantum coho- 
mology. In the SLjy case, Bertram [Bel used (0) to prove a 'quantum Giambelli 
formula' for the Schubert classes in the small quantum cohomology ring of the 
Grassmannian. The degeneracy locus problem in loc. cit. occurs on a Quot scheme 
|Gro| and it is crucial that |(5J holds for an arbitrary morphism tp. There is a 
type C analogue of the Quot scheme, and one can ask whether natural Lagrangian 
analogues of [X^] can be expressed in terms of the Chern classes of the bundles 
involved. In Section^we show that no such formula exists (Proposition!^ by an- 
alyzing the structure of the Quot scheme iQi(2,4), which compactifies the space 
of degree 1 maps from to the Lagrangian Grassmannian LG{2, 4). We hope this 
example is of independent interest. 

Here is a brief outline of this article. In Section^we introduce the type C double 
Schubert polynomials £^(X, Y) and prove their basic algebraic properties. Section 
|21connects this work to the geometry of symplectic and Lagrangian degeneracy loci. 
The double Schubert polynomials and loci for the orthogonal types B and D are 
studied in Section |3| Finally, Section 0] presents the example of the Lagrangian 
Quot scheme LQi(2,4). 

The authors would like to thank Piotr Pragacz for communication regarding his 
work with Lascoux jLPlj |LP2| . The computational techniques with symplectic 
and orthogonal divided difference operators developed in these papers are essential 
tools in the present work. We also wish to thank Sara Billey for her comments 
on an earlier version of this paper, and an anonymous referee for remarks which 
prompted us to develop our theory of polynomials systematically. It is a pleasure to 
thank the Institut des Hautes Etudes Scientifiques for its stimulating atmosphere 
and hospitality in the fall of 2000. 

1. Type C double Schubert polynomials 



1.1. Initial definitions. Let us begin with some combinatorial preliminaries: for 
the most part we will follow the notational conventions of |M3I Section 1] ; although 
not strictly necessary, the reader may find it helpful to identify an integer partition 
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A = (Ai, . . . , Ar) with its Young diagram of boxes. The sum ^ A; of the parts of A 
is the weight |A| and the number of (nonzero) parts is the length £{X) of A. We set 
Xr = for any r > £{X). Define the containment relation yu C A for partitions by 
the inclusion of their respective diagrams. The union A U ^, intersection A fl /i and 
set-theoretic difference A\/i are defined using the (multi)sets of parts of A and fi. A 
partition is strict if all its nonzero parts are different; we define p„ = (n, n— 1, . . . , 1) 
and let I?„ be the set of strict partitions A with X C Pn- For A G I?„, the dual 
partition A' = /9„ \ A is the strict partition whose parts complement the parts of A 
in the set {1, . . . , n}. 

Define the excess e(A) of a strict partition A by 

e(A) = |A| - (1 + • • ■ + eiX)) = |A| - £{XmX) + l)/2. 

More generally, given a, f3 £ I?„ with a n /? = 0, define an intertwining number 
e{a, (3) as follows; for each i set 

mi{a,P) ^ #{j \ ai> /3j > a^+i } 

and 

e(a,/3) = y^Jmi{a,(3). 
Oi 

Note that for any A S we have e(A, A') = e(A). 

We will use multiindex notation for sequences of commuting independent vari- 
ables; in particular for any k with 1 ^ fc ^ n let Xk ~ (xi, . . . ,Xfc) and = 
{yi, . . . , Uk); also set X = Xn and Y = ¥„. Following Pragacz and Ratajski |PR2 | . 
for each partition A with Ai ^ n, we define a symmetric polynomial Q\ G as 
follows: set Qi{X) ~ ei{X) to be the j-th elementary symmetric polynomial in the 
variables X. For i,j nonnegative integers let 

Q,,,iX)^Q,iX)Q,iX) + 2J2i-'^fQ^+kiX)QJ-k{X). 

k=l 

If A = (Ai 5^ A2 ^ • ■ ■ ^ Ar 0) is a partition with r even (by putting A^ = if 
necessary), set 

Qx{X) = Pfaflian[Q;,,,;,^(X)]i^,<j^,. 

These Q-polynomials are modelled on Schur's Q-polynomials S_ and were used 
in |PR2| to describe certain Lagrangian and orthogonal degeneracy loci; we will 
generalize these results in the following sections. We also need the reproducing 
kernel 

Q{X,Y)= Qx{X)Qy{Y). 

For more information on these polynomials we refer to |PR2| |LP1| . 

Let Sn denote the symmetric group of permutations of the set {1, . . . , n} whose 
elements a are written in single-line notation as (cr(l), (t(2), . . . , a{n)) (as usual we 
will write all mappings on the left of their arguments.) Sn is the Weyl group for the 
root system A„_i and is generated by the simple transpositions Si for 1 ^ i ^ n — 1, 
where Si interchanges i and i + 1 and fixes all other elements of {1, . . . , n}. 

The hyperoctahedral group W„ is the Weyl group for the root systems i?„ and 
C„; the elements of Wn are permutations with a sign attached to each entry. We 
will adopt the notation where a bar is written over an element with a negative 
sign (as in jLPlI Section 1]); the latter are the barred entries, and their positive 
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counterparts are unbarred. Wn is an extension of Sn by an element so which acts 
on the right by 

The elements of maximal length in 5„ and Wn are 

tuo = (ri, n — 1, . . . , 1) and wa — (1,2, . . . ,n) 

respectively. Let X C Pn he a strict partition, £ = £{\) and k = n — £ = £{\'). The 
barred permutation 

w\ = (Ai, . . . , A£, Ajj, . . . , \[) 

is the maximal Grassmannian element of Wn corresponding to A (for details, see 
Prop. 1.7] and pTTn] [HI]). 
The group Wn acts on the ring A[X] of polynomials in X with coefficients in any 
commutative ring A: the transposition Si interchanges Xi and Xi+i for 1 ^ i ^ n — 1, 
while So replaces xi by —xi (all other variables remain fixed). The ring of invariants 
is the ring of polynomials in A[X] symmetric in the X'^ = (xf , . . . , x'^). 
Assume that 2 is not a zero divisor in A. Following |BGGj and |D1| |D2| . there 
are divided difference operators i9i : A[X] A[X]. For 1 ^ i ^ n — 1 they are 
defined by 

diif) = {f - SiJ)/{xi - Xi+i) 

while 

5o(/) = (/-5o/)/(2xi), 
for any / G ^[-'i^]- For each w £ Wm define an operator dw by setting 

dw^ da^o-- - o da,. 

if w = ■ ■ ■ Sq^ is a reduced decomposition of w (so r = ^(w)). One can show 
that du] is well-defined, using the fact that the operators di satisfy the same set 
of Coxeter relations as the generators Si,0^i^n— 1. In the applications here 
and in the next section we will take A = Z[Y]. For each i with 1 ^ i ^ n — 1 we 
set 9- = —di, while 9q := Oq. For each w S Wn we use d'^ to denote the divided 
difference operator where we use the (3-'s instead of the di's. 

Following Lascoux and Schiitzenberger |LS| [H we define, for each w € Sn, & 
type A double Schubert polynomial &j^{X, Y) G 1\X, Y\ by 

e^(x,y) = a^-i^„ (A(x,r)) 

where 

A(X,r)= n (x.-y,)- 

Our main references for these polynomials are |M1| |M2| . The type A (single) 
Schubert polynomial is ©^(X) := ©^(X, 0). The double and single polynomials 
are r elated by the formula |M2l (6.3)] 

(4) 6^(x,y) = ^64x)6,(-y), 

u,v 

summed over all u^v ^ Sn such that u — vw and t{w) — i{u) + i{v). 
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1.2. Main theorems. Wc intend to give analogues of the polynomials 6t^{X,Y) 
for the other classical groups, and begin with the symplectic group. Our definition 
is motivated by the properties that follow and the applications to the geometry of 
degeneracy loci in Section |2| 

Definition 1. For every w G Wn the type C double Schubert polynomial Y) 
is given by 

(LUX,Y) = (-l)"("-^'/^a:„-^„„ [a{X,Y)Q{X,Y)) . 

The polynomials := €wiX,0) have already been defined by Lascoux, 

Pragacz and Ratajski IPR,2| [LPIL Appendix A], where they are called symplectic 
Schubert polynomials. It is shown in loc. cit. that the enjoy 'maximal Grass- 

mannian' and 'stability' properties. We will see that the type C double Schubert 
polynomials €w {X, Y) satisfy an analogue of the former but are not stable under 
the natural embedding Wn-i ^ Wn in general. Note that the F) differ 

from the polynomials found in [LP II Appendix B3] , because the divided difference 
operators in loc. cit. (which agree with those in F3 ) differ from the ones used in 
Definition ^ ^ For the precise connection of the €w {X, Y) with geometry, see the 
proof of Theorem |31 

Let €\{X, Y) = i^i for each partition A e 2?„. In type A, when -ro S S'„ is 
a Grassmannian permutation tu\, the Schubert polynomial 6^^{X,Y) is a multi- 
Schur function (see [M2I (6.14)]). We may thus regard the ^\{X,Y) as type C 
analogues of multi-Schur determinants. Our first theorem gives a determinantal 
expression for these functions. 

Theorem 1 (Maximal Grassmannian). For any strict partition A G I?n the double 
Schubert polynomial ^\{X^Y) is equal to 

(_l)e(A)+| A'l ^ g„(X) 5](-l)^("-'3)+l/'lQ(„u«'(>^) det(e^._,. (r„_,. )), 

a p 

where the first sum is over all a G I?„ and the second over [3 G I?„ with /3 D A', 
andar\l3 = %. 

Proof. We argue along the lines of the proof of |LP1I Theorem A. 6]. Let £ — ^(A), 
k = n — £ and observe that w\ = wg t\ vjk (5^7 , where 

T\ = (Ajj, . . . , A'l, Ai, . . . , Af) 
tufe = (fc, ...,2,l,fc+l,...,n) 
4 = (s£ • • • siSo)(s£+i • • • siSq) ■ ■ ■ (s„_i • • • siso); 

it follows that 



Lascoux and Pragacz have informed us that the polynomials (t^i (X, Y) were defined in a 
preliminary version of [LPl]. 
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Now compute 

(5) d,-i{AiX,Y))^6^,rAX,Y) 

k "-^j 

(6) = n n (^k+i-j - ijp) 

j=l jy=l 

7 j=l 

In the above calculation equality ^ holds because the permutation 

^oTx = (n + 1 — Afc, . . . , n + 1 — A'l, n + 1 — Ai, . . . , n + 1 - Af) 

is dominant |M2I (6.14)], and the sum iQ is over all fc-tuples "f — (71, . . . ,7^) of 
nonnegative integers. 
Observe that 

where Vi — d'^_i ■ ■ ■ d'ldo. The action of (Vi)'' relevant to our computation is 
explained by Lascoux and Pragacz; if j/j ^ n — i for 1 ^ i ^ k then |LP1I Lemma 
5.10]: 

(vo'^K^ • --xi" ■ /) = Viix'f • • • ViK^ • Vi(xr •/))•••) 

for any function / symmetric in the X variables. Moreover [LP II Theorem 5.1] 
states that if A G Vn and < r ^ n then \/i{x'^~'^Q\{X)) vanishes unless Xp ~ r 
for some p, in which case 

Viix^-'-QxiX)) - (-l)f-iQA.,(X). 

Using the above facts and equation Q we deduce that 

dl^^^^^{A{X,Y)Q{X,Y)) = (Vi)^- (Q(x,r)9;_,(A(x,y))) 

a p 

where the ranges of summation are as in the statement of the theorem and r(A) = 
£(ta) + k{k - l)/2 + |A'|. Finally, note that 



and the signs fit to complete the proof. □ 

In Section |21 we apply Theorem ^ to obtain formulas for Lagrangian degeneracy 
loci. 

Let * : S'n — > S'n be the length preserving involution defined by 

The next theorem shows that for w G Sn, the polynomial €t^{X,Y) is closely 
related to a type A double Schubert polynomial, with the X variables in reverse 
order. See Sect ion lOl for a geometric interpretation. 
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Theorem 2 (Positivity). For every zu ^ Sn, 

€^iX,Y)=e^>inJoX,-Y). 
In particular, €tx^{X,Y) has nonnegative integer coefficients. 
Proof. Let vq — vjqWq-, then the analysis in [LP 11 Sect. 4] gives 
(8) d',^{6u{X)Q{X,Y)) = (-l)^(")6„(ti7oX) 

for every u ^ Sn- We now use (0J and (|HJ to compute 



= e^,iwoX,-Y), 

where the above sums are over all u,v G Sn with u = vzuq and £{u) + £(v) — £{wo). 
It follows that for any zu G Sn , 

(9) €UX,Y)^d'^^,^^{wo&^,iX,-Y)) 

(10) =ruod^,^-i J2 &uiX)eu^,{Y). 

«es„ 

Applying |M2 (4.3)] gives 

6u^^,{X) if e{u) + eiw) + e{uvj) = 2£(n7o), 



(11) d^,^-.e^ix) - ^ ^ ^^^^^^.^^ 

We now use Hll|) in H1Q|) and apply Q to obtain 

{X,Y)^wo6 (^,->'), 

which is the desired result. □ 

Combining Theorem [21 with the known results for type A double Schubert poly- 
nomials gives corresponding ones for the (^^^^^{X, Y). For example, we get 

Corollary 1. For every zu Sn we have €j^{X) — 6^<-{zuqX). Moreover 

e:^(x,y) = ^G:„(x)£,(t:^o>') 

u,v 

summed over all u,v £ Sn with u = vvj* and £(u) + £{v) = ((zu). 

1.3. Product basis and orthogonality. Following Lascoux and Pragacz |LP1I 
Sect. 1] (up to a sign!), we define a Z[X]'^" -linear scalar product 

(12) ( , ) : Z[X] X Z[X] — ^ Z[X]^" 

by 

(13) (/,<?) =9^0 (/5) 

for any f,g e 1[X]. For each partition A G !?„ let 1x{X) = 1x{X,Q) = Q\{X). 
We deduce from Corollary [T] and |M1[ (4.11)] that the set {€^{X)}^^s^ is a free 
Z-basis for the additive subgroup of 1>[X] spanned by the monomials {x"^ ■ ■ ■ x"" }, 
with ai ^ i — 1 for each i. It follows that the {£ro(^)}roGS„ form a basis of Z[X] as 
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a Z[X]-^" -module. In addition, we know from |PR2l Prop. 4.7] that {€x{X)}xev„ 
is a basis of Z[X]'^" as a Z[X] ^"-module. 

Proposition 1 (Orthogonality), (i) The products {€^{X)€\{X)} form G 5„ and 
A £ I?„ /orm a basis for the polynomial ring Z[X] as a 'Z[X]^'^ -module. Moreover, 
we have the orthogonality relation 

(14) (^€uiX)€x{X),€,^,i~moX)€^,iX)'^ = 5u,Jx,t. 

for all u,v £ Sn and A, /i G I?„. 

(ii) Let €^,\{X) — (Lj;^{X)€x{X) and suppose u,v e Sn and A,/i G I?„ are such 
that£{u)+£{v) = n{n-l)/2. Then 



(15) (£„,A(^),e„,^(X)) 



1 if V = tuqu and /i = A', 
otherwise. 



Proof It is shown in [TPTl Sect. 1] that Z[X] is a free Z[X]^" -module with basis 
{&^{X)Qx{X)}, for zu G S'„, A G I?„. Furthermore, this basis has the orthogonal- 
ity property |LP1I p. 12] 



6. 



,{X)Qx{X),&,^„{^zuoX)Q^,{X)'j = {-lY^^°'>Su^Jx.^, 



Part (i) follows immediately by applying Corollary ^ To prove (ii), factor d^^ = 
dygd^g (where = ■u^o'^^o) and observe that 

(16) (^<iu,x{X)Xv,M)) = d^,{€^{X)G:,{X)) ■ d,,i(S:x{X)€^{X)). 

Now use (|16|) and the corresponding properties of the inner products defined by 
d^a and dyg (stated in jMj (5.4)] and [LPl. (10)], respectively). □ 

Note that the polynomials in the basis {C^^x{X)} have positive coefficients, 
but do not represent the Schubert cycles in the complete symplectic flag variety 
Sp{2n)/B. The orthogonality relations 1)141) and H15|l are however direct analogues 
of the ones for type A Schubert polynomials jMlH (5.4) (5.5) (5.8)]. The divided 
difference operator in (|13|l for the maximal length element corresponds to a Gysin 
homomorphism in geometry (see |BGG| |D1| jAC| ) . 

Let {£'"'^(^)}(t^,A)eS„xi?„ be the Z[X]^"-basis of Z[X] adjoint to the basis 
{(t^^xi^)} relative to the scalar product ifT^ . By Proposition ^ we have 

(17) C-'^X) = €^^,i-moX)(^x'{X). 
We now obtain type C analogues of !M2!, (5.7) and (5.9)]: 
Corollary 2 (Cauchy formula). We have 

(L^„iX,Y) = Y,^r.r.„h^oX)€x'{X)€UmoY)(LxiY) 

■cu.X 

^Y.€^'^{X)€^^x{^oY), 
summed over all zu G Sn o>nd A G T>n- 
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Proof. We use (@J and the definitions in Section ITTTl to get 
€^„{X,Y) = e^„iY,X)QiX,Y) 

= &^{Y)6^^„i~X) J2 Qx{X)Qy{Y). 

The result now follows from Corollary and l|17() . □ 

1.4. Examples. 1) The type C double Schubert polynomials for n = 2 are 

^(T,2) = ^ Xi)Q{X2, Y2) = {yi - Xi){xi +X2+yi+ V2){xiX2 + V1V2) 

•2^(1,2) = ~x\x2 + {xl - yl)yi + X2yl £(24) = Q(^2, ^2) 

•^(2,1) = ^1^2 + (2:1 + 2:2)^1 + yl £(2,1) = xl + X2{yi + y2) + yiy2 
£(2,1) = ^2 + yi £(T,2) ^ ^1 + ^2 + yi + y2 

e^(l,2) = 1- 

2) The type C double Schubert polynomials C^j f^or n — 3 and zu € S3 are 

2^(3,2,1) = {x2 + yi){x3 + yi){x3 + y2) 
2^(2,3,1) = + 2;i)(a;3 + y2) ^{3,1,2) = (2^2 + yi)(a;3 + yi) 
2^(2,1,3) = 2:2 + a;3 + 2/1 + y2 '^^(1,3,2) = a;3 + 2/1 

2^(1,2,3) = 1- 

3) For fixed n and i = 0, l,...,n — 1 we have 

(LsA^.Y) ^ Xi+i ^ h 2:„ + yi H h • 

4) Consider the partition A = pk for some k ^ n. Then Theorem Ogives 
(18) '^p.{X,Y)= J2 Qo.iX)Qp,^a{Y). 

Further special cases of Theorem ^ are given in Corollaries [3 and |H1 

1.5. Stability. For each to < n let i = im,n- Wm ^ Wn be the embedding via 
the first m components. The maps im,n are used to define the infinite hyperocta- 
hedral group Woo — Un^"- ^^^^ ^ ^YP^ double Schubert polynomial 
€w{Xm, Ym) with w G W„j is stable if 

for all n > m. Theorems and |21 show that this stability property fails in general, 
even for maximal Grassmannian elements. For example when m = 2, n = 3 and 
w = (2, 1) we have 

£»(«,) (^3,^3) I = a;iX2 + (xi +a:;2)(yi +2/2) + yi +yiy2 + yi 

which differs from <L^{X2,Y2), given in Example 1. In addition, Theorem [3 shows 
that the only permutation w € Sn for which (E..^(X, Y) is stable is nj = 1. 

For u,v G Woo we say that u precedes v in the weak Bruhat order, and write 
u < ?j, if there are generators Sai , • • ■ , Sa^ € Woo with v — usa-^ ■ ■ ■ Sa^ and r = 
£{v) — i{u) ^ 0. For each A: > let Wp^, be the maximal Grassmannian permutation 
corresponding to pk, that is 

Wp^ = [i,/c- l,...,T,/c + l,/s + 2,...] e VKoo. 
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Proposition 2 (Stability). If w < Wp^ for some k > then (Lw{X,Y) is stable. 

Proof. Equation H18|l above shows that {X, Y) is stable when w = Wp^ . It follows 
from the definition of the polynomials {X, Y) by divided difference operators that 

r.f^ _ ( £tus, if wsi < w, 
^ ^ \ otherwise. 

This implies that if <^^{X,Y) is stable, then so is F) for any u <w. □ 

The elements w = (wi, W2, . . .) G Woo which satisfy the hypothesis of Proposition 
13 are characterized by the following three properties, which should hold for all 
i < j: (i) if Wi and Wj are unbarred then Wi < Wj, (ii) if Wi and Wj are barred 
then \wi\ > Iwjl, (iii) the barred entries are smaller than the unbarred entries in 
absolute value. One sees that the only maximal Grassmannian elements w\ with 
these properties are the Wp^. themselves. 

Lascoux, Pragacz and Ratajski have shown in .LPl, Thm. A. 2] that the sym- 
plectic Schubert polynomials £to(X) are stable, for any w G W,„, in the sense that 

^i(iu) (^n) I j,^^^^_..._^^_Q = ^wi^^rn)- 

When w is a maximal Grassmannian element w^, the stability of <tw{X) = Q\{X) 
is clear. Stability for ^^{X) when w g 5'„ is less obvious, and is equivalent (by 
Corollary^ to the following 'shift' property of type A single Schubert polynomials, 
which can be checked directly. 

Corollary 3. // vo £ Sn with ^7(1) — 1 and t is the n-cycle {n . . . 21), then 

&UrX)\^^^„^e,^,-.{X). 

1.6. Further properties. The next result uses the Cauchy formula of Corollary 
121 to give a characterization of the type C double Schubert polynomials. 

Proposition 3. Suppose that we are given a homogeneous polynomial P^g{X, Y) £ 
■L[X,Y], andforeachw G define P^{X ,Y) = (P^„ (X, F)). Let P^{X) = 

P^{X,Q) and P\{X) = P„,^(X, 0) for every pair (tn. A) £ 5„ x !>„. Assume that 
these polynomials satisfy the following properties: 

(i) P^M.y) = Y.r..xPr-^o{~^^X)Py{X)P^{woY)P>,{Y) 

(ii) P^„ {X) = {moX) ^X2xl---xl-^ and Pp^ {X) = Qp^ {X) . 
Then P^{X, Y) = €^{X, Y) for all w G W„. 

Proof. Recall that if a polynomial / is homogeneous of degree d, then d[f is homo- 
geneous of degree d—1 for each i. Hence, the definition of the polynomials P^ and 
their normalization in (ii) imply that Pt^{X) is homogeneous of degree (,{w). In 
particular Pi„(0) ~ unless w ~ 1, when Pi{X) = 1. Properties (i) (with Y = 0) 
and (ii) thus give 

p^„ix) = p^„{-^oX)Pp,sx) = (-i)"("-^'/'6„„(x)Qp„(x) = q:^„(x). 

We deduce that P^{X) 9^-i^,„(-P™o(^)) = '^wiX) for all w G Wn- The result 
now follows from (i) and Corollary [3 □ 

We close this section with a vanishing property, which reflects the fact that the 
top polynomial ^wo{X,Y) represents the class of the diagonal in flag bundles (see 
[CTF^ Thm. 1.1], (EH Sect. 8] and SectionEJ. 
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Proposition 4 (Vanishing). We have 



q:^jx,wX) = 



2"-xi---Xnll.^.{xf -x'^A if w = Too e S"™, 



i>j\ 

otherwise. 



Proof. The vanishing property for Q{X,Y) from |LP1I Sect. 2] gives 

[ otherwise. 

On the other hand, A{X,njX) ~ for all m ^ Sn \ {^^o}- ^ 

2. SyMPLECTIC DEGENERACY LOCI 

2.1. Main representation theorem. Let F be a vector bundle of rank 2n on 
an algebraic variety X. Assume that F is a symplectic bundle, i.e. V is equipped 
with an everywhere nondegenerate skew-symmetric form V (!^ V —^ C Consider 
two Lagrangian (i.e., maximal isotropic) subbundles E,FofV together with flags 
of subbundles 

= Eo C El C E2 C ■■■ C E„ = E CV 
= Fo C Fi C F2 C ■■■ d F„ = F (ZV, 

where dimi^^ = dimi^^ = i for all i. These can be extended to complete flags E,, 
F, in V by defining En+i ~ E^_^ for 1 ^ i ^ n, and similarly for F,. For each i 
with 1 ^ i ^ n let 

Xt = -ci{En+i-t/En-t) and yi = -ci{FjFi^i). 

There is a group monomorphism (f> : Wn ^ S2n with image 

'/'(W'n) ^ {(J e S2n I cr(i) + (T(2n + 1 - «) = 2n + 1, for all i }. 

The map (p is determined by setting, for each w — (wi, . . . , w„) G Wn, 



(19) (b{w)ii) 



n + 1 — Wn+i^i if Wn+i-i is unbarred, 
n + lU„+i_i otherwise. 



For every w G W„ define the degeneracy locus Xw C X as the locus of a G X such 
that 

diin{Er{a) H Fs{a)) ^ #{i!^r \ (j){w){i) >2n- s} for 1 < r < 1 ^ s ^ 2n. 

The precise definition of Xw as a subscheme of X is obtained by pulling back from 
the universal case, which takes place on the bundle F{V) ^ X of isotropic flags in V, 
following |F3| : see also |FPI Sect. 6.2 and App. A]. If G, denotes the universal flag 
over F{V), then the flag E, corresponds to a section a: X ^ FiV) of F{V) X 
such that a*{G,) = E,. The degeneracy locus Xw C X is defined as the inverse 
image a~^{Xw) of the universal Schubert variety X^ in F(V). 

Assume that X^ is of pure codimension £{w) and X is Cohen-Macaulay. In this 
case, we have a formula for the fundamental class [X^j] of Xu, in the Chow group 
CH^^'^\X) of codimension £{w) algebraic cycles on X modulo rational equivalence, 
expressed as a polynomial in the Chern roots X = {xi} and Y = {yi} of the vector 
bundles E and F. The exact result is 

Theorem 3 (Locus Representation). [X^] = e:^(X,r) in CH'^'^^\X). 
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Proof. We will show that the above statement is equivalent to the corresponding 
result in |F3| (Theorem 1). Note that, as in loo. cit., the proof is obtained by 
pulling back the corresponding equality on the flag bundle F{V). In order to avoid 
notational confusion define new alphabets U = (wi, . . . , u„) and Z = (zi, . . . , z„) 
with 

Ui ^ -CiiEi/Ei^i) = Xn+i_, and = -Ci(F„+i_.,/F„_.,) = 

in agreement with the conventions in |F3| . Identify the Weyl group Wn with its 
image 0(W„) C 52,1 and let 9",..., 9" denote the divided difference operators 
with respect to the u variables, defined as in loc. cit. For example i9^(/) = (/ — 
Snf) / {'iun), where s„ sends u„ to — u„. Theorem 1 of F3^ gives 

(20) [X.,] = (A([/, Z) FiU, Z)) , 
where 

F{U,Z) = det (e„+i+j_2i(f^) + e„+i+j-2i(^))jj ■ 

Using the criterion in "Gra" Theorem 1.1], we see that one can replace the kernel 
A(C/, Z) F{U, Z) in ^ with 

(21) (-l)"(»-i)/2 ^[u, _ y^) F{U, Y) = (-l)"("-i)/2n7o(A(C/, Y)) F{U, Y), 

i>j 

where the permutation zuq acts on the u variables (compare with the analysis in 
|Gra[ Section 5]). Next we apply |LP1[ Proposition 2.4] to replace F{U,Y) in 
by Q{U,Y), as these two polynomials are congruent modulo the relations in the 
Chow ring of the flag bundle of V. Note also that we have the identities 

(22) dll_,^vDo^ -ruod'-, li^ti^n-l, and a,>o = t^oc'^, 

where we define 9q (/) — (f — so/)/(2ui). The map 4> interchanges Si with s„_i for 
all i; it follows from (EOJl, ^ and ^ that 

[X^] = (-l)"("-i)/2^o(5:-,^J' [a{U,Y)Q{U.Y)) = €UX,Y), 

as required. □ 

2.2. Lagrangian degeneracy loci for subbundles. We turn next to the special 
case of Theorem O which describes Lagrangian degeneracy loci. Note that the vari- 
ables X — {xi, . . . , Xn} are the Chern roots of E* and for each i, Yi = {yi, . . . , yi} 
are the Chern roots of F*. For each strict partition A G Vn define the degeneracy 
locus Xa C X as 

(23) Xa = { a G X I dim(£;(a) n F„+i_a. (a)) ^ i for 1 ^ i ^ £(A) }. 

The precise scheme-theoretic definition Xa is obtained as before, by pulling back the 
corresponding universal locus X^j^^ by the section a. There is an equality Xa — 
of schemes, hence the analysis in Section |0] applies. Assuming that Xa is of pure 
codimension |A| and X is Cohen-Macaulay, Theorem |31 says that the fundamental 
class [Xa] equals €\{X,Y) in the Chow group Ci7l^l(X). Now Theorem □ gives 

Corollary 4 (Lagrangian Degeneracy Loci) . We have 

[x,] = {~i)<'^+\''\Y.Q^{EnY.i~ir('^''''^^^^^ 

a p 
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in CH^^^{X), where the first sum is over all a £ I?n and the second over j3 S 'Dn 
with 13 D X', t{l3) = ^(A') andaC^P^^. 

We can apply Corollary 0] to recover the results of |PR2| which compute the 
class [Xa] for some special partitions A. For instance, when X = k for some k ^ n 
the locus 3l\ is given by a single Schubert condition. Let Sr denote the Schur 
polynomial (or complete homogeneous function) corresponding to r. 

Corollary 5 f |PR2| . Proposition 6.1). We have 

k 

[X,] = ^Cp(i?*)sfe_p(F„V_,). 

Proof. For each p < k there is an equality of [k — p) x (k — p) matrices 

(24) {ei+j_i(y„_fe+j)} = {ei+j-i{Yn-k+i)} ■ {ej-iiYn-k+j \ i^n-fc+i)}- 
Taking determinants in l|24(l shows that 

(25) det(ci+j_i(^;t-fe+j))K'*,Kfe-P ^ Sk-p{F*_k+i). 
Now apply Corollary^ and use (|^ to obtain 

k k 

[Xfc] = ^cp(£;*)sfe_p(K+i-J + 

p=l q=l 

The proof is completed by noting that 

k 

'^{-lY~'^eq{Y)sk-q{Yn+l-k) = dct (ci+j-i (y„+l_i) ) l^j J<;fc = Sfc(y„+l_fc), 
9=1 

which follows from (|25|l and the Laplace expansion of a determinant. □ 

When A = p^, CoroUary^becomes Theorem 9.1 of |PR2| . More generally, we have 
the following result: 

Corollary 6. Let A = pfc \ j for an integer j with 1 ^ j ^ k. Then 

k 

[^a]=E(-1)'"%-^(^"%-) E (-l)'^"'"^Qa(i?*)Qp,.(aUp)(^^*) 

Qnp=0 

where e{a,p) = #{i | Ui > p}- 

Remark. The formula for Lagrangian degeneracy loci in Corollary ^ (and its 
predecessor from Theorem ^ interpolates between two extreme cases, where it 
assumes a simple form. These correspond to the partitions X = pk (Example 4 
in Section nj and X = k (Corollary 15)), and were derived in |PR2| using purely 
geometric methods. Note that a very different formula for the X = pk locus is 
given in |F2j |F8| : it would be interesting to have an analogous statement for the 
remaining maximal Grassmannian loci. 
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2.3. Restriction of type A loci. We now give a geometric interpretation of The- 
oremEl in the setting of flag bundles. Let F'{V) be the partial S'i2n-flag bundle 
of which parametrizes flags of subbundles 

with dimSj- = i for all i; by abuse of notation let E', also denote the universal flag 
of vector bundles over F'{V). Suppose that 

= F(5 C Fi' C C • • • C = y 

is a fixed complete flag of subbundles of V, and set 

x[^-ci{El/El_,) and y', ^ -c^iF^n+i-./FL-j) 

for 1 ^ i ^ n and 1 ^ j ^ 2n. For any permutation zu € Sn, we have a universal 
codimension Schubert variety X'^ in F'{V), defined as the locus of a G F'{V) 
such that 

dim(F^(a) n F!,{a)) ^ #{i!^r \ w{i) >2n- s} for 1 ^ r n, 1 ^ s 2n. 

Identify zu with a permutation in S'2„ by using the embedding Sn ^ which 
fixes the last n entries. Then the class of in CH^'-^'>{F'{V)) is given by 

where X' = {x[, . . . ,x'^,0, . . . , 0) and Y' = {y[, y'^J. This follows from [Fll 
Prop. 8.1] by dualizing; to navigate through the changes in notation, we have found 
|FF1 Sect. 2.2] helpful. 

Let : F{V) ^ F'{V) be the natural inclusion and 9* : CH{F'{V)) CH{F{V)) 
the induced homomorphism on Chow groups. Define the complete flag F'^ by set- 
ting Fj — Fj for 1 ^ j ^ 2n. We then have 0*{x[) = Xn+i-i for 1 ^ i < n, and 
hence can identify 9*(X') with wqX, where wq denotes the longest element in Sn- 
The symplectic form on V induces isomorphisms V/ {Fj~) = F* for each j; it follows 
that 0*{y[j) = —yj for 1 ^ j ^ n. Using the stability property of type A double 
Schubert polynomials |M1I (6.5)] and |F1I Cor. 2.11] we see that 

(26) 9*{&^{X',Y')) = e^{moX,-Y) = (H^^iX^Y), 

where the last equality is Theorem El 

On the other hand, by comparing the defining conditions for X'^ and X^- one 
checks that 

9-Hx'j^Fiv)nx'^^x^, 

and that the intersection is proper and generically transverse along X^* ■ It follows 
that 

(27) 9*[X'J = [X^,] 

and thus TheoremElcorresponds in geometry to the restriction of universal Schubert 
classes (P7|l. 
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2.4. Schubert calculus. We now suppose that is a symplectic vector space 
and let X = Fsp{V) denote the variety of complete isotropic flags in V. There 
is a tautological isotropic flag E, of vector bundles over X, and we let F, be a 
fixed isotropic flag in V. For each w e Wn the locus is a Schubert vari- 
ety in X; let cr^ = [Xw] £ CH^'^^\X) be the corresponding Schubert class. The 
classes {<Jw\we:Wn form an integral basis for the Chow ring CH{X). Hence, for each 
u,v,w ^ Wn, we can define type C structure constants f(u, v, w) by the equation 

(28) au<J^ ^ ^ f{u,v,w)aw. 

The f{u, V, w) are nonnegative integers. 

Theorem 01 implies that = <Zw{X), that is, the symplectic Schubert polyno- 
mials represent the Schubert classes. We deduce that the {'tw{X)}u)£Wr, form a 
Z-basis for the quotient ring Z[X]/J„, where /„ denotes the ideal of positive degree 
Weyl group invariants in (using the well known isomorphism of the latter 

with CH{X); see e.g. \Bo\). Recall that the type A Schubert polynomials &t^{X) 
for VD £ Sn form a Z-basis for the additive subgroup of Z[X] spanned by the 
monomials x", a C Pn-i |M1I (4.11)]. Using Corollary^] we obtain 

Corollary 7. Fix a permutation m £ Sn- Suppose that (i) the polynomial £ 
Z,[X] represents the Schubert class a^^ in CH{X) = Z[X]//„ and (ii) G zvoHn- 
Then P^{X) = ^^{X) = e^,{wQX). 

We will apply the results of Section ^ to obtain some information about the 
structure constants f{u,v,w). For this we need the following 

Definition 2. Let u,v d Sn be two permutations. We say that the pair {u,v) is 
n-stable if the product 6u{X)6y{X) is contained in H„. 

The previous remarks show that (u, v) is n-stable exactly when there is an equation 
of type A Schubert polynomials 

(29) 6„(X)6„(X)= Yl c{u,v,w)eUX) 

for some integers c(m, u, w) (which are type A structure constants). 

Examples. 1) If it e Sk and v £ Si then (m, v) is n-stable for any n ^ fc + ^ — 1. 

2) Let < denote the weak Bruhat order. The Leibnitz rule for divided differences 

(30) d,{fg)^{d,f)g+(s,}){d,g) 

implies that if (u,w) is n-stable and u' < u, v' < v then {u',v') is also n-stable. 

3) For each i > and w £ Soo let di{m) = deg^. (Sro(-^))- Then {u,v) is n-stable 
if and only if di{u) + di{v) ^ max{n — i,0} for all i. One sees that di{vD) equals 
the number of nonempty columns in the diagram of tu, or alternatively 

di(n7) = #{j I 3 i < j : w{i)>w{j)}. 

This follows e.g. from the combinatorial algorithm for constructing Schubert poly- 
nomials due to Bergeron |M1I Chap. 4]. In particular, di{vj) ^ n7(l) — 1 for all vj. 
We deduce that if u(l) -I- v{l) > n+1 then the pair (u, v) is not n-stable. 

4) For any partition A (not necessarily strict) and integer r ^ there is a 
Grassmannian permutation wx^r G Soo, determined by wx^ri}) = + i for 
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i ^ r and vux,r{i) < ^\,r{'i + 1) for i > r. One knows ,M2: , (4.7)] that (for n 
sufSciently large) the Schubert polynomial 6ro;^^(X„) is equal to the Schur function 
sx{xi, . . . , Xr)', moreover deg2,.(sA) — Ai for each i. Let /j, be a second partition 
and assume that the integer s satisfies £{fj,) ^ s ^ r. We deduce that the pair 
{zu\^r, '^fi.s) is n-stable if and only if n ^ Ai + max{r, /ii + s} — 1. 

5) If ccj £ Sn we denote by 1 x the permutation (1, ■cu{l) + 1, . . . , zu{n) + 1) in 
Sn+i- We then have the following 

Proposition 5. Suppose that u,v d Sn- Then {u,v) is n-stable if and only if 
{1 X u,l X v) is {n+ 1) -stable. 

Proof. Given the Schubert polynomial &ixu{X) one can recover 6u{X) by using 
CorollaryEl It follows easily from this that if (1 x u, 1 x v) is {n + l)-stable then 
{u, v) is n-stable. For the converse, apply jMli (4.22)] to obtain 

(31) 6ixu(^) = di--- 9„_i(xi ■ • ■x„_i6„(X)) 

for every u € Sn. Assuming that (u, v) is n-stable, we deduce that (1 x u, 1 x i;) is 
{n + l)-stable from H30|l . (|31|l and a straightforward induction. □ 

Extend the involution * : S'„ ^ S'n of Section 11.21 to all of Wn by letting w* — 
Wqwwq, for each w G Wn- 

Proposition 6. Assume that {u,v) £ Sn x Sn is n-stable. Then for each w S Wn, 



(32) f{u*,v*,w*) 



c{u, V, w) if W G Sn, 
otherwise. 



Proof. We apply the permutation tuo to the polynomials in (|29|l . then use Corollary 
nto obtain 

C„.(X)g:,-(X) - c{u,v,w)(L^.{X), 

wes^ 

and compare this with (|28|) . □ 

Remarks. 1) li u,v G Sm then {u, v) is n-stable for any n ^ 2m — 1, thus (|32|l is 
true for all such n. Hence every type A structure constant c{u, v, w) appears as the 
stable hmit of type C constants f{u*,v*,w*), with the involution * defined using 
the rank of the corresponding hyperoctahedral group. 

2) Poincare duality for the Schubert classes in the complete Sin-flag variety implies 
that 

c{u, V, w) = c{u, zuqw, wqv) = c{u*, v*,w*) 

for all u,v,w € Sn. Moreover, the structure constants c{u,v,w) and f{u,v,w) are 
stable under the inclusions of the respective Weyl groups. These properties are 
compatible because of the general identity 

(33) c(l X u, 1 X w, 1 X w) = c(u, V, w), 

valid for all u,v,w £ Soo- Note that (|33|l is a special case of |BSI Cor. 4.5.6]. 

3) The special case of the Fieri rule of jPRl| displayed after Example 2.3 of loc. cit. 
and the Giambelli-type formula in |PH1I Cor. 2.4] are consequences of FropositionEl 
applied to (non-maximal) isotropic Grassmannians. To recover these formulas from 
PropositionEl notice that if zu\ G S'„ is a Grassmannian permutation corresponding 
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Fibration 


Fsp{2n) LG{n, 2n) = LG 


FsL{n) X LG^ LG 


Basis 




{£ro,A(-'^)}(ro,A)6S,.xX'„ 


Group 


Sn X (Z2)" = Wn 


Sn X (Z2)" 



Table 1. 



to the partition A, then zuqVJxvuq is also Grassmannian and corresponds to the 
conjugate (or transpose) of A. 

Table H illustrates the connections between some of the geometric, algebraic 
and combinatorial objects in this paper. There is a fibration of the symplectic 
flag variety Fsp(2n) — Sp(2n)/ Bi over the Lagrangian Grassmannian LG{n, 2n) — 
Sp{2n) / Pn, with fiber equal to the SLn-Hag variety FsL{n) — SL{n)/ B2- The right 
column in Tabled corresponds to the trivial product fibration FsL{n) x LG{n, 2n). 
The symplectic Schubert polynomials give a Z-basis for the cohomology (or Chow) 
ring in either column, as shown. When restricted to the parameter spaces Sn 
and Vm the Schubert polynomial and product bases coincide. The correspondence 
between the set T>n and the group (Z2)" = {±f}" is given as follows: the strict 
partition A S Vn corresponds to the vector (e^) G {if}" with 

J —1 if r is a part of A, 
1^ 1 otherwise. 

3. Orthogonal Schubert polynomials and degeneracy loci 

In this section we describe the analogues of the main results of Sections and 
13 for the orthogonal groups of types i?„ and D„. The alphabets Xk and Yfc for 
1 are defined as before, with X — Xn and Y = Yn- For each A G P„ define 

the P-polynomial 

Pa(X)-2-^(^)Qa(^) 
and, for fc G {rt — the reproducing kernel 

h{X,Y)^ J2 Px{X)Pp,^x{Y). 

3.1. Type B double Schubert polynomials and loci. The Weyl group of the 
root system Bn is the same as that for C„, as are the divided difference operators 
di for 1 ^ i ^ n — 1. However the operator differs from the one in type C by a 
factor of 2: 

doU) = (/ - so/)/a^i 
for any / e ^[-'i^]- In this and the next subsection we will take A — Z[l/2][y]. The 
di are used as before to define operators d'^ for all barred permutations w € Wn- 

Definition 3. For every w G Wn the type B double Schubert polynomial 58^ (X, Y) 
is given by 

^^{x,Y) = (-i)"("-^)/^9;-..,„ (A(x,r)p„(x,r)) . 
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For each partition A £ Vn let ^\{X,Y) = F). Using the resuhs of 

|LP2I Appendix] and the same arguments as in Section produces the following 
two theorems. 

Theorem 4 (Maximal Grassmannian) . For any strict partition X G 2?„ the double 
Schubert polynomial ^\{X,Y) is equal to 

a [3 

where the first sum is over all a G and the second over (3 G I?n with /3 D A', 
^£{\') andar\l3 = %. 

Theorem 5 (Positivity). For every zu £ Sn^ 

In particular, ^^(X,Y) has nonnegative integer coefficients. 

Consider an orthogonal vector bundle V of rank 2n + 1 on an algebraic variety 
X, so that V is equipped with an everywhere nondegenerate quadratic form. One 
is given flags of isotropic subbundles of V as before, with E = En and F = Fn- 
These are extended to complete flags E, and F, by setting En+i = E^_^_^_^ and 
Fn+i = for f ^ z ^ n + f. The classes Xi,yi e CH^{X) are defined as in 

Section 13 In this case we have a monomorphism Tp: Wn ^ S2n+i with image 

^{Wn) = { cr e S2n+i \ cr{i) + o{2n + 2 - ?:) = In + 2, for aU i }, 

determined by the equalities 

, r n+\-Wn+\-i if w„+i_i is unbarred, 

[ n + 1 + Wn+i-i otherwise 

for each w ~ (wi, . . . ,m„) £ Wn- The degeneracy locus is the locus of a £ X 
such that 

dim(£'r(a) n Fs{a)) ^ # { i < r | ^p{w){i) > 2n + 1 - s } 

for l^r^n, l^s^ 2n. Assuming that X^ is of pure codimension £{w) and X 
is Cohen-Macaulay, we have 

Theorem 6 (Locus Representation). [X^] = ^w{X,Y) in CH^'^'^\X). 

The proof of this theorem is the same as its analogue in Section 12 using the 
corresponding results of |F3| . |Graj and jLP2| . The maximal isotropic degeneracy 
loci Xx for A £ T>n are defined by the same inequalities (|23|l as in the symplectic 
case. By combining the two previous theorems we immediately obtain a formula 
for the class [Xa] in Ci?l^'(X): 

Corollary 8. We have 

[Xx] = {-ir^^^+\^'\Y.Po.mY.^~^y''''-^'^^^^^ 

a 13 

where the first sum is over all a £ Dn cmd the second over [3 £ I?„ with /3 D A', 
£{(3)^l{\') and a 0(3 = 9. 
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3.2. Type D double Schubert polynomials and loci. The situation here differs 
significantly from that of the previous sections, so we will give more details. The 
Weyl group W„ of type D is an extension of Sn by an element So which acts on 
the right by 

(U1,M2, • • ■,Un)sn = (U2,Ui,U3, . . .,«„). 

Wn may be realized as a subgroup of W„ by sending sn to sqSxSq. The barred 
permutation Wq G Wn of maximal length is given by 

~ _ J if n is even, 

'^'^-\ (l,2,...,n) if n is odd. 

For 1 ^ i ^ n — \ the action of the generators s, on the polynomial ring A\X\ 

and the divided difference operators di arc the same as before. We let Sn act by 
sending [xi^x^) to {—X2, —xi) and fixing the remaining variables, while 

du{f) := if -saf) /ix,+X2) 
for all / e ^[-^^l- Define operators dl = —di for each i with 1 ^ i ^ n — 1 and set 
d'n := dn; these are used as above to define and d'^ for all w G W„. 

Definition 4. For every w G Wn the type D double Schubert polynomial 2)^ {X, Y) 
is given by 

^UX,Y) = [A{X,Y)Pn-i{X,Y)) . 

The maximal Grassmannian elements wx in W„ are parametrized by partitions 
A G Vn-i- For each such A we set £ = £{X); then 



k = 



= (Ai + 1, . . . , A^ + 1, 1, iin-e-i, • • • , Ml) 

where ji = pn \ (Ai + 1, . . . , A^ + 1, 1) and 1 is equal to 1 or 1 according to the 
parity of £. Let A' = Pn-i \ A be the dual partition of A and 

n — t if n = i (mod 2), 
n-e-1 \i ni-i (mod 2). 

Let be the set of strictly decreasing sequences /? of elements of the set 

{0, 1, . . . ,n — 1}, with length equal to the number of terms in the sequence. 
We think of as consisting of partitions in T>n-i, possibly with an 'extra zero 

part'. If a G I>„_i and /? G V+_^ let 

ni{a,(}) = #{j \ ai > Pj ^ ai+i} and f{a,(3) = ^ini{a,f3). 

i=l 

Also define 

e(A)+£(A) if n = ^ (mod 2), 
e(A) if n 7^ I (mod 2) 
and note that /(A) = /(A, A'), provided that A' is identified with an element in 
T^n-i °f length k. Let D\{X, Y) = Dwx '^^ can now state 

Theorem 7 (Maximal Grassmannian 1). For any strict partition A G "Dn-i the 
double Schubert polynomial Tlx{X,Y) is equal to 

(_l)/(A)+|V|^p^(^)^(_l)/(a,«+„|p^^^^^,(y)det(e,._,,(r„_,_,,)), 

Q /3 



/(A) = 
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where the first sum is over all a G Pn-i and the second over (3 G 'Dn-i P ^ ^' ! 
e{P) ^ k and anp 

Proof. Given A G I?n-i define £ and k as above and associate to A a partition v of 
length k as follows: 

_ ( /)„ \ (Ai + 1, . . . , Af + 1) if n^e (mod 2), 
" 1 P„ \ (Ai + 1, . . . , A^ + 1, 1) a n^£ (mod 2). 

Note that wx — wqTx Wk 6^^ ^ where 

\ (i/fe, . . . ,1/1, Ai + 1, . . . , Af + 1) if n ^ (mod 2), 
" \ {vk, . . . , i/i, Ai + 1, . . . , Af + 1, 1) if n ^ ^ (mod 2) 

tUfe = (fc, . . . , 2, 1, fc + 1, . . . ,7l) 
4 = (s„-fe ■ • • S2SlSn-k+l ■ ■ ■ S2Sn) ' ' ' (s„-2 ' ' ' S2SlS„-l ' ' ' 8280)] 

hence 

We compute as in the proof of Theorem ^ 

(34) 9,-1 (A(x, = n n (^fc+i-^- - ) 

(35) = ^(-i)!^!-!--! n.x;:;i%e..-..(>^n-..) 

7 j = l 

where the sum ()35|l is over all /c-tuples 7 = (71, . . . , 7fe) of nonnegative integers. 
Observe that 

since fc(fc — l)/2 = fc/2 (mod 2). The operator St^^ is a Jacobi symmetrizer; hence 
for any partition 9 = {9i) we have d^^ (x^^ ■ • ■ x^!') = unless 61 > 62 > ■ ■ ■ > Ok, 
when 

9^^(2:1' ■ ■ - x^^) = se^„fc4.i^e2„fc4.2^...,9fc(xi, .. .,Xk) 

is a Schur S'-polynomial. In the latter case we can apply jLP2l Theorem 11] and 
deduce that for any partition A G 

unless each part of = [n — 1 — 6k, ■ ■ ■ ,n — 1 — 9i) G occurs in A. In this 

case, the image is {~l)^'^°''^'Pa{X) where a — \ (note that the operator du in 
|LP2| differs from ours by a sign). Moreover, if (mi, . . . , mj,) is a fc-tuple of distinct 
nonnegative integers and cr G S'fe is such that 771^(1) > • • • > ^(j{k) then 

d^, {xr^-'-x^")^ sgn{a)d^, [xT''-^^ • • • xr""=' ) , 
hence the previous analysis applies, up to sgn{a). 
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Noting that — 1 = X'j for 1 ^ j ^ fc and = |A'| (mod 2), use H35() to compute 



k 



£(7) = fe 

= (-ir(^)^P„(X)^(-l)/("'«+l'^IP(„u^),(y)det(eft_v.(>;.-i-A;.)) 

where the ranges of summation are as in the statement of the theorem and r(A) = 
i(T\) + k{k - l)/2 + |A'|. Finally, observe that 

«-'^H + Q-fr)./(A,+ Q) + 0(»a., 

so the signs fit to complete the proof. □ 

The analogue of Theorem El in type D„ differs from the one in type B„ . Let 
H = (Z2)"~^ be the normal subgroup of Wn consisting of those elements equal to 
(1, . . . , n) in absolute value. For each uj € Sn, define the parameter space 

L{-cu) ^{w emH \ e{w) = £iw)}. 
Theorem 8 (Positivity). For every m ^ Sn, 
(36) J2 ^AX,Y)^e^,iwoX,-Y). 

Proof. We argue along the lines of the proof of Theorem [2 using the operator 

n = (an + d[)d', {da + d[) {d',d',) • • • ((?□ + d[) id'„_, ■■■a',) {da + d[) 

in place of d'^^. We claim that the image of U: Z[1/2][X] -> Z[1/2][X] is a free 

Z[l/2][X]'^"-module with basis {&m{'cuoX)}^^s,^- This statement is a type D 
analogue of |LP1I Prop. 4.1], and the proof is similar. The only difference is that 
here we use the relation {da — d[) 11 = 0, and thus d'^^^^ {da ~ d[) 11 = 0, for each 
A G I?n-i- Moreover, |LP2I Cor. 16] implies that 

1 if /i = A, 



d'idu - d[){P,{X)) 



if l^il = |A| but fi^X 



(note that d'^,^^^ On = d'^^). Now the vanishing property for P„_i(X, Y) from |LP2I 
Prop. 2] and the same argument as in |LPil Sect. 4] show that 

n(6„(x)p„_i(x,y)) = {-if^^&u{w^x) 

for every u G Sn- 

Observe, since L{wq) = wqH, that 11 = '12wgl(j:^o) ^w-^wq' deduce as in the 
proof of Theorem 12 that 

(37) ^w{X,Y) = i-lY^^«^n{A{X,Y)Pn-iiX,Y)) = &^,{moX,^Y). 

For any permutation zu, apply the operator to both sides of equation (|37|l . 

We have seen that 

(e^„ {woX, -Y)) = 6^. {woX, -Y), 
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SO it remains to show that 

for all zu G Sn- To prove this, note that for each w G L{wq), the operator 
d'^-ij:^gd'^-iwo either vanishes or equals S^-i^^, for a unique u e L{w). More- 
over, different elements w lead to different elements u. □ 

Note that the number of terms in the sum equals 2'^^'^\ where h{w) is 
defined to be the number of j > 2 such that ■uu{i) > zu{j) for all i < j, that is, the 
number of 'new lows' in the sequence ^0(1), . . . , zu{n). 

Corollary 9. If m ^ Sn satisfies — 1, then 

In particular, D^{X,Y) has nonnegative integer coefficients. 

Consider now a vector bundle V of rank 2n on an algebraic variety X with a 
quadratic form and rank n isotropic subbundles E and F with complete flags of 
subbundles as in the type C setting. We assume that E and F are in the same 
family, that is dim(i?(a) fl F{a)) = n (mod 2) for every a £ X. Define the classes 
Xi,yi £ CII^{X) as before. 

There is a monomorphism (f) : Wn ^ S'2n whose image consists of those permu- 
tations cr G S2n such that cr(i) + cr(2n + I — i) = 2n -f 1 for all i and the number of 
i ^ n such that a{i) > n is even. The map ((> is defined by the same equation H19|) 
as in the type C case. Set 5(w) = if 1 is a part of w, and S{w) = 1 otherwise, and 
define 0: Wn ^ S2n by 

The map is a modification of (f) so that in the sequence of values of 4>{'w), n + 1 
always comes before n. We need also the alternate complete fiag F,, with Fi = Fi 
for i ^ n — 1 but completed with a maximal isotropic subbundle Fn in the opposite 
family from E. Define 

, ^ r F. a n = S (mod 2), 
• \ F, if n^S (mod 2). 

For w G Wn , the degeneracy locus Xw is the locus of a G X such that 

dim(£;^(a) n Ff('")(a)) ^ # { i s$ r | 0(w)(i) >2n-s} 

for l^r^Ti, l^s^ 2n. Recall that the flag E, corresponds to a section 
a: X ^ F{V) of the bundle F{V) — > X of isotropic flags in V. The subscheme X^, 
of X is then the inverse image under a of the closure of the locus of y G F{V) such 
that 

diiii{Eriy) n Fsiy)) = #{1 < r | (/)(wowwo)(«) >2n-s} 

for l^r^n— 1, l^s^27i. This relates the present formalism to that in 'F3'. 
With the same assumptions on X and the codimension of X^ as before, and with 
the same arguments, we obtain 

Theorem 9 (Locus Representation). [X^] = 2)^(X,y) m Ci7^("')(X). 
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The maximal isotropic degeneracy locus Xx for A G Pn-i is defined as 

(38) Xa = { a e X I dim(£;(a) n F„_a, (a)) >i for 1 i sC ^(A) }. 
Theorems 13 and El imply the following formula for the class [Xx] in Ci/l^l(X): 
Corollary 10. We have 

[Xx] = {-l)f'-'^+\''\Y.Po.iEnY.i-l)f'---^^^^^^ 

a 13 

where the first sum is over all a € 2?n-i o-nd the second over (3 £ T^n^i with (i D A', 
= fc and an/? = 0. 

3.3. Further results. The Propositions, Corollaries and Examples in Sections 
and 121 have orthogonal analogues. In particular there are geometric interpretations 
of Theorems m and IHl (as in Section and connections to the formulas of |PR2| 
for types B and D. We omit most of them here because their statements and proofs 
are straightforward, following the type C case. The specialization Y = Q produces 
type B and D Schubert polynomials 

(39) 25„(X) = »^(X,0) and 2)^(X) = S)„(X, 0). 

Note that these polynomials differ from the orthogonal Schubert polynomials de- 
fined in ,LP2_ by a sign, which depends on the degree. It is however still true 
(arguing in the same way as |LP1I Thm. A. 2]) that the polynomials (|39|l have a 
stability property: for any w S Wm, 

where i : Wm ^ W„ is the natural embedding. In addition, the set {^^{X)^x{X)} 
for G7 € S'n, A S Vn forms an orthogonal product basis of A[X] with respect to the 
A [X]'^" -linear scalar product 

A[X] X A[X] — > A[X]^- 

defined by the maximal divided difference operator, as in H13() and Proposition^ 
(here A = Z[l/2]). Similarly, the Dw{X) are stable under the inclusion Wm ^ Wm 
and the products {£i^{X)Dx{X)} for vj E Sn, A G "Dn-i form an orthogonal basis 
for A[X] as a ^[X]'^- -module, where T)^{X) := J^weLi^) ®™(^)- 

We next discuss some properties special to the type D double Schubert polyno- 
mials. Fix an integer £ > 0, let y„ = (j/i, . . . , Un-i, —yn) and define 

Y ^ f Y,, if n^e (mod 2), 
~ \ Y„ if n^i (mod 2). 

Theorem 10 (Maximal Grassmannian II). For each strict partition A G "Dn-i of 
length £, the double Schubert polynomial Dx{X,Y) is equal to 

i^l)<^H\^'\Y^P^iX)Y,[-l)<-^'>)+h\p^^^^^^ 

a 7 

where the first sum is over all a G Vn-i and the second over 7 G 2?ri-i with 7 D A', 
£(7) = ^(A') and a 07 = 0. 
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Proof, li n ^ t (mod 2), then the claim follows directly from Theorem [3 Assume 
that n ~ I (mod 2), fix a partition a G Vn-i and equate the coefficients of Pa{X) 
in the sums that occur in Theorems 171 and 1101 

(40) (~l)^^(-l)/("'^)+l''l%u/3)'(>;^)det(eft_v.(>'n-i-A;.)) = 

(41) ^(-l)«("'^)+I^IP(„u,)'(?n)det(e,._v(y„_i_v.)). 

7 

To prove this equality, we expand each determinant det(e^._;^' (y„_i_;^' )) in H40|) 
along the last (/cth) column, and compare with H41|l . The result then follows by 
using the identity in the next Proposition (for varying /i and r). 

Proposition 7. For each partition fi G T>n-i of length r, we have 

r 

Y.{-ir'P,~.,Ayn)e,AYn-l) = (-lY+'P,{Yn)+MYn). 
i=l 

The proof of Proposition Ul while elementary, uses additional algebraic formalism, 
and is given in [ET2l Appendix]. □ 

Corollary 11. For each strict partition A £ 2?ri-i of length I, the maximal isotropic 
degeneracy locus X\ of H38() satisfies 

[Xy]^{-l)<^^+\^'\Y.P^{E*)Y,{-lY<'-^'')+^^^^^ 

where the first sum is over all a G I?„-i, the second is over 7 € I'n-i with 7 D A', 
£(7) = i{X') and an J = 9, while 

p ^ [ Fn li n = l (mod 2), 
\ F„ if n ^ ^ (mod 2). 

Examples. 1) We have 

^su {X, Y) = (1/2)(X1 + . . . + X„ + 2/1 + . . . + Vn-l ± Vn), 

with the sign of y„ positive (resp. negative) if n is even (resp. odd). Also, 

Ds, {X, Y) = (l/2)(-Xi + ...+Xn+yi+ ■■■+ Vn-l T Vn), 

with the opposite sign convention for y„. Note that Tisa + = = while 
J),^ = *B^^ = for i > 1. 

2) Theorem 1101 gives 

Dp,(x,r)- ^ p„(x)Pp,-.„(y). 

It is clear from the above examples that the type D double Schubert polynomials 
do not satisfy the same stability property as in types B and C. However, we see 
that for each ^ > 0, the polynomial Dp^ {X, Y) is stable, in the sense of HI. 51 
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4. Example: the Lagrangian Quot scheme iQi(2,4) 



In this section we study the problem of extending the formula for degeneracy 
loci from Corollary^ to degeneracy loci of morphisms of vector bundles satisfying 
isotropicity conditions, in analogy with the work of Kempf and Laksov 'KL' in type 
A. We provide an example showing that a direct analogue of the Kempf-Laksov 
result fails in type C. This example hinges on two ingredients: Quot schemes and 
degeneracy loci for a morphism from a flagged symplectic vector bundle to a vector 
bundle. Both of these, while classical for type A, have not received attention in the 
other Lie types. We begin with a description of degeneracy loci (we shall see that 
there are two reasonable definitions, although our example will be for a particular 
A G "Dn for which the two definitions agree), and later introduce the Lagrangian 
Quot scheme L(5i(2,4) which serves as a compactification of the moduli space of 
degree 1 maps iG(2,4). 

4.1. Lagrangian degeneracy loci for isotropic morphisms. Let X be an al- 
gebraic variety over any ground field. Let be a symplectic vector bundle of rank 
2n over X with complete isotropic flag of subbundles Fi, 1 < i < n, and let Q 
be a vector bundle of rank n over X. We say that a morphism of vector bundles 
ip: V —>■ Q is isotropic if the composite Q* ^ V* —>■ V Q is zero, where the 
middle map is the isomorphism coming from the symplectic form on V. For such 
an isotropic morphism ip and for A G P„, we define the Lagrangian degeneracy loci 
X'^ and X" by 

(42) X';, = { a e X I rk(F„+i_A, (a) ^ Q{a)) ^ n + 1 - i - X, for 1 i ^ £{X) } 

(43) X'l^{aeX\ Tk{F^_^^_^^ (a) Q{a)) s: n - i for 1 s: i < ^(A) }. 

When ip is surjective, conditions (|42|l and (|43|) are equivalent to (|23|l (with E = 
KerV'), and X^ = X". If ip is not everywhere of full rank, we only have X'^ C X^ 
in general. However, when X — pk for some fc, the two definitions above yield the 
same scheme, and we may speak without ambiguity of the Lagrangian degeneracy 
locus of the morphism ip. For instance, when A — (1), both H42|l and (|43|l are 
the same as a type A degeneracy locus, so the Kempf-Laksov formula (O dictates 



Proposition 8. Fix n = 2 and X = (2,1), and consider a general smooth variety 
X with vector bundles V, Q, Fi, F2 and isotropic morphism -tp: V Q as above. 
Then there is no polynomial in the Chern classes of these bundles whose value equals 
[X'^] in CH*{X) whenever X'^ has codimension 3. 

We will work over C and consider the special case where the ambient bundle 

V as well as the fiag of isotropic subbundles F, are trivial. We therefore have 

V = Ox W and Fi = Ox ® Wi for some symplectic vector space W of dimension 
N — 2n, with a fixed flag of isotropic subspaces Wi C • ■ • C Wn- If ip is surjective 
(and E — Ker-0 as above) then for any A £ I?„, only the leading term of the 
Lagrangian degeneracy locus formula in Corollary 01 survives, hence 



in CH* (X) , provided the degeneracy locus Xa of (|23|l has the expected dimension. 

It is straightforward to give examples of the failure of (|44(l for isotropic mor- 
phisms of vector bundles. For instance, consider X — P'^, A = (2, 1), Q — 0(1) © 




ci(Q) -ci(K). 



(44) 



[Xa] = Qx{E*) 
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g. 



and [a : b : c : d] are the homogeneous coordinates on P'^. To prove Proposition |S1 
we will produce an example of an isotropic morphism of vector bundles V* E* 
on a nonsingular projective variety X, surjective at the generic point, such that the 
degeneracy locus X\ is smooth of the expected codimension, but whose fundamental 
class is not equal to any polynomial in the Chern classes of E. The example was 
motivated by the theory of quantum cohomology, and we explain this connection 
next. 

4.2. Quantum cohomology of Grassmannians. The theory of degeneracy loci 
for morphisms of vector bundles has a direct application to the study of the quantum 
cohomology of flag manifolds in type A (see e.g. p3e) |FPI App. J] IC-Fp . In the case 
of the S'LAT-Grassmannian G, Bertram [Bej used the formula (0) of Kempf-Laksov 
|KLj to prove a 'quantum Giambelli formula'. The quantum Giambelli formula 
calculates the class of a Schubert variety in the (small) quantum cohomology ring 
QH*{G), with respect to a given presentation of this ring in terms of generators 
and relations. 

It is natural to copy Bertram's arguments and work towards a quantum Giambelli 
formula for the type C (as well as type D) maximal Grassmannian varieties, contin- 
gent upon having a formula such as ()44|l in the situation of a morphism V* E* , 
which is generically the projection to a Lagrangian quotient bundle. Unfortunately, 
this approach would dictate the wrong quantum Giambelli formula. The simplest 
example is provided by the Lagrangian Grassmannian LG ~ LG{2, 4) of isotropic 
2-planes in C^. 

The (small) quantum cohomology ring QH*{LG) is generated by the special 
Schubert classes cti and 172, together with a formal variable q of degree 3. The 
structure constants of QH*{LG) are the numbers of rational curves on LG satisfying 
incidence conditions (also known as Gromov-Witten invariants). Lines on LG are 
parametrized by the P'^ of linear subspaces £ oi C^: 



Fixing the line in LG determined by £0 C C*, as well as a point Eq G LG in general 
position, i.e., satisfying ^0 ^ 5]o, we ask how many lines on LG are incident to this 
line and this point. Clearly we have conditions £ C Eq for the line corresponding 
to £ to pass through the point, and £ C £q for the line to meet the given line; 
thus there is a unique line on LG incident to a line and a point in general position. 
Consequently, the quantum product of the Schubert classes cti and CT2 receives a 
quantum correction term with coefficient 1: 

(47) (ji * CT2 = a2A + q 

(here cr2.i is dual to the class of a point in LG and equals the classical cup product 
CTi U a2)- Using the arguments of [Be| . a formula such as (|44|l which is valid for 
morphisms would predict no quantum correction term in This discrepancy 



{ E I £ C E C £^ }. 
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leads to a counterexample to (|44|l for isotropic morphisms, which we study in detail 
for the remainder of this section. 

The loci of H42|) on Lagrangian Quot schemes (defined below in the situation 
that we require) are the 'correct' ones for analysis of the quantum cohomology 
of Lagrangian Grassmannians in analogy with |Be| . Our particular analysis will 
involve X = p2, for which the loci X^, X" coincide anyway. For more information on 
the quantum cohomology of Lagrangian Grassmannians, including the full quantum 
Giambelli formula for LG{n,2n), see 

4.3. Quot schemes: a review. Grothendieck's Quot schemes jGro| parametrize 
quotients with given Hilbert polynomial of a fixed coherent sheaf on an algebraic 
variety. If G{m, N) denotes the Grassmannian of m-dimensional subspaces of = 
C^, then a morphism P-'^ G(m, N) is equivalent to a map Opi (g) 14^ — > Q to a 
rank n :~ N — m quotient bundle Q. The Quot scheme Qd parametrizing quotient 
sheaves of Opi (^W with Hilbert polynomial n^ + n + d is a smooth projective variety 
which compactifies the moduli space of degree d maps G{m, N). On Qd x 
there is a universal quotient map ip: O ® W ^ Td- While Td is not locally free in 
general, the kernel Sd of ■0 is locally free. The intersection-theoretic ingredient in 
|Be| is the Kempf-Laksov formula (01 applied to the (nonsurjective) dual morphism 

OQ,^ri®W* ^ S*d. 

On our way to defining the Lagrangian Quot scheme, we review the m = 1, = 2 
case of Quot scheme just described, namely the Quot scheme compactification of 
the parameter space PGL2 of maps P^ ^ P^ . Let be a vector space of dimension 
2. The Quot scheme parametrizes short exact sequences 

— >S — >W ®Ori — >Q — >0 

with Q of rank 1 and degree 1. So S must be isomorphic to C'pi(— 1), and the Quot 
scheme Qi is the space of nontrivial maps of bundles Opi(— 1) — > (g) Opi, up to 
multiplication by a global scalar. 

Choosing a basis for W and a basis {x, y} of Hom((!)(— 1), O), we have Qi = P"^ 
with universal sheaf sequence 

ax + by\ 
cx + dy 

— >C'(-1,-1) ' > ' 0®0 — >Q — ^0 

on P'^ X P^, where \a:h : c: d\ are the homogeneous coordinates on P'^. 

4.4. Quot scheme of maps to LG{2, 4). We now take W = C^, endowed with the 
standard symplectic form (|46|l . We introduce the Lagrangian Quot scheme LQi = 
LQi{2,A). Consider the functor which parametrizes rank 2 degree 1 quotients 
of Opi (g) W which are (generically) Lagrangian: the symplectic form defines an 
isomorphism W — > O^W*, and the Lagrangian condition on an exact sequence 

(48) — > S — yOri®W — yQ — >0 

is that the composite 

S — yO®W — yO®W* — > S* 

is the zero map. Since the Lagrangian condition is a closed condition, such quotients 
are parametrized by a closed subscheme LQi of the usual Quot scheme Qi. 
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A typical afSne chart of the Lagrangian Quot scheme looks like 



/I 
9 







O 



'0{-l) 
.r, s]/{e- 



\ 

X + dy 
ex + fy 

\s gx + hyj 

> 

qg-sj + qh 



0(g)W — >Q — >0 
- sd)) X P^. Such charts cover LQi, 



on {Spec k[d, e J, g,h,q, 
hence LQi is smooth. 

When S — * Opi ® is of full rank, there corresponds a morphism from to 
the Lagrangian Grassmannian LG{2, 4). Since LG{2, 4) is a quadric hypersurface in 
a four-dimensional projective space, and since lines on LG{2, 4) are parametrized 
by P'^, we expect the parameter space of degree 1 maps P^ LG'(2,4) to be a 
PGL2-bundle over P"^, compactified by the Lagrangian Quot scheme. 

Since it is needed below, we record the sheaf sequence corresponding to the 
compactification of the space of degree 1 maps LG(2,4) whose image passes 



through a fixed point in LG. The parameter space is a copy of . 



which we 



endow with homogeneous coordinates [a : b : c : d] and [& 



The sheaf sequence is the following sequence on 

fs 
t 



t] on respective factors, 
ml . 







(49) — ^0(0, -1,0)© 0(-l, -1,-1) 



s{ax - 
-t{cx 
s{cx H 



\ 

by) 
-dy) 
dy) ) 



0. 



We note the geometry: lines through a fixed point on LG sweep out a quadric 
cone which is a singular hyperplane section of LG under its fundamental (Pliicker) 
embedding. The [s : t] coordinates select the line. For each fixed [s : i], the 
compactification of the parametrized maps to this line is a copy of P'^, just as in 
the previous subsection. 

Proposition 9. The Lagrangian Quot scheme LQi{2,4) compactifying the space 
of degree 1 maps from ¥^ to LG{2,A) is isomorphic to the projectivization of the 
bundle R (B R on P'^, where R is a rank 2 vector bundle which fits into an exact 
sequence 

nls{i) 



(50) 







3(-l) 



R 



0. 



More naturally, in fact, LQi ~ P{R Hom(0pi(— 1), O)). Recall from Section 
14.21 that lines on LG(2,4) are parametrized by the of 1-dimensional subspaces 
£ C W. To each such i we associate the set of isotropic 2-dimensional subspaces of 
W containing £, or equivalently, the set of 2-planes containing £ and contained in 
£'^. Thus any map P^ — > LG{2,4) determines a one-dimensional subspace £ C W. 

We describe what happens on the level of points, and then we prove Proposition 
El by phrasing everything in terms of universal bundles. In any exact sequence 
(BHll . the splitting type of S must be O ® 0{—l). As in the previous subsection, 
it is easier to describe the vector bundle S with injective morphism of its sheaf of 
sections to Oi^iW, than it is to describe the quotient sheaf Q. The line £ associated 
to a morphism P-'^ LG{2, 4) can be recovered from the sheaf sequence (I48II as the 
image of the map on global sections 

T{s) — >w ^ r(Opi ® w). 
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This makes sense even if ^ O eg) T4^ is not everywhere of full rank. So to every 
point of LQi we can associate a line in W. 

The bundle R is constructed to have fiber i-^/l at the point of corresponding 
to £ C W. An element of / £) (E)ilom{Opi (—1), O)) determines a sheaf morphism 

(51) Opi(-l)^Opi®(£^/£). 
What we seek is a morphism 

(52) Opi ® Opi (-1) — > Opi (g) W 

with image contained in Opi ® and whose map on global sections has image £. 
Points of the projectivization of {£^ /£) ® Hom(C'pi (—1), O)) correspond exactly to 
morphisms (I51II up to global automorphism of 0{—l), i.e., a global scale factor. 
Such a morphism 151(1 in turn determines, uniquely, a morphism (|52|) which sends 
global sections into I, up to global automorphism of O © 0{—\). 

Proof of Proposition\^ Let U ~ 0{—l) be the universal subbundle on P"^, and let 
R = /U , where _L refers to the standard skew-symmetric form ( , ) on W , and 
hence also on Ops ® W . The first claim is that R fits into an exact sequence (|50|l . 
This is clear, since the (dualized, twisted) Euler sequence on P'^ 

— > — >0-^ — >U* — ^ 

identifies with U^. 

On P'' X P^ there is the natural map of vector bundles 

i?®Hom(Opi(-l),Opi) ® Opi(-l) — > R. 

Let P := P(i? ®Hom(C'pi (—1), Opi)) — > P^ be the projectivization of the indicated 
vector bundle. We follow the convention of jF4j : points of P are points of the 
base together with one-dimensional subspaces of the fiber. Let S* = C'_p(— 1) be the 
universal subbundle of i? ® Hom(C'(— 1), O)) on P. Then we have a morphism of 
bundles on P x P^ 

S ® Opi (-1) — > i? = U^/U (Z{0® W)/U. 
Over any affine open subset of P'^, this lifts to a morphism 

(53) O ©(5*0 Opi (-1)) — >0®W, 

such that, fiberwise, the map on global sections has image U. To phrase this 
mathematically, let if denote the projection P x P^ ^ P, and equally, the restriction 
over an affine open of P^ . Then applied to (|53|l should be an isomorphism onto 
U <Z O ® W. This requirement determines the lift, uniquely up to automorphisms 
of the fibers of O ® {S (g> Opi (-1)). 

Since the Quot functor is a sheaf, these maps, defined locally, patch to give a 
vector bundle E and injective map of sheaves ii^— >Oc>5W^onPxP^, such that 
the quotient sheaf is flat over P and on every fiber of P x P^ — * P has rank 1 
and degree 1. The resulting morphism P — > LQi is an isomorphism since it is a 
birational morphism of smooth varieties, which is one-to-one on geometric points. 
□ 

The natural map ip*(p^:E E identifies a rank 1 subbundle of E with the 
puUback to P X P-'^ of the universal subbundle on P"^. If we let tt denote the 
composite projection P x P^ ^ P P-^, then the cokernel of 7r*J7 — > P, restricted 
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to TT^^{A) for any afRne open set A C P^, is identified with S ® C'pi(— 1). This 
identification is unique up to scahng by an invertible regular function on Tr^^(A). 
Hence, there is an exact sequence 

— yTT*U — >E — y S (g, TT* L ® Opi (-1) — > 

for some hne bundle L on P^. For any line A in P'^, the restriction of E to 7r~-'^(A) 
must be the subsheaf in the sequence up to isomorphism, so we deduce that 
L = Op3(— 1). Thus we have 

Corollary 12. Under the isomorphism P{R(BR) — LQi from Proposition\^ the 

universal subsheaf E of O ®W on LQi x P^ fits into an exact sequence 

— >Op3(-l) — yE — >5®Op3(-l)®Opi(-l) — >0, 
where S is the universal subbundle on P{R © R). 

4.5. Chern class computations on LQi. Consider, on X LQi x P^, the 
trivial rank 4 bundle V = Ox ® W, with standard symplectic form H46|l and flag of 
isotropic subbundles F, = {F, } (where Fi is the subbundle of sections with nonzero 
entries only among the first i coordinates). The kernel of the universal quotient 
map on X is the vector bundle E from Section [4.41 Dualizing, we get a morphism 

(54) i::V*'^E* 

which is isotropic. On LQi 2± P{RQ)R) we let h denote the hyperplane class on the 
P^ base of the projectivized vector bundle, and we let z denote the first Chern class 
of Opi 

RS)R)i^) (so ^ = — ci(S'), where S is the universal subbundle on P{R © R)). 
Let p be the class of a point on P^. Since R has Chern polynomial 1 + h^t'^, the 
Chern polynomial of i? ® i? is 1 + 2h^t^. Hence, the Chow ring (or cohomology 
ring) of X is given by 

CH{X) = Z[h, z,p]/{h'^, + 2h^z^,p^). 

By Corollary El we have 

ci{E*) = 2h + z+p, 

C2{E*) = h'^ + hz + hp, 

ci{E*)c2{E*) = 2h^ + 3h^z + 3h^p + hz^ + 2hzp. 

Recall that we have defined Lagrangian degeneracy loci X';^, X'^ associated to 
an isotropic morphism to a fiagged vector bundle. We consider A — (2, 1) and the 
morphism since A = p2, we have X^ — X'^. Translating the condition lH^ 

into conditions on E, we have 

X^ = {ae X I rk(£;(a) ^ {V/F2){a)) =0}. 

If L C P^ is the line which parametrizes one-dimensional subspaces of F2, then X^ 
is the hypersurface in 'k~^{L) ~ P^ x P^ x P^ (where tt is the projection X ^ P^ 
as in the previous subsection) defined by the homogeneous equation cx + dy ^ 
in the coordinates of 149|) . So X';i^ has the expected codimension 3 (and, in fact, is 
smooth). Its class in the Chow ring is 

(55) [X^] = h'z + h^p + ci{E*)c2iE*) = Q2AE*)- 

The above continues to be an inequality upon restriction to LQi x {[1 : 0]}. In 
fact, restricting (|^ to a section of LQi x {[1 : 0]} ~ P(R © i?) P^ reproduces 
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the example ()45|l of Section ITTI Observe now that the class H55|l is not equal to 
any polynomial in the Chern classes of E. In particular, this proves Proposition |H1 
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